International Journal of Electrical and Computer Engineering (IJECE) 
Vol. 8, No. 5, October 2018, pp. 3778~3783 
ISSN: 2088-8708, DOI: 10.1159 1/ijece.v8i5.pp3778-3783 O 3778 


CBIR of Batik Images using Micro Structure Descriptor 
on Android 


Agus Eko Minarno', Yuda Munarko’, Arrie Kurniawardhani* 
Universitas Muhammadiyah Malang, Malang, Indonesia 
Universitas Islam Indonesia, Yogyakarta, Indonesia 


Article Info ABSTRACT 
Article history: Batik is part of a culture that has long developed and known by the people of 
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Accepted May 7, 2018 patterns related to local customs and values. Therefore, it is important to 
introduce knowledge about batik motifs and patterns effectively and 
Keyword: efficiently. So, we build CBIR batik using Micro-Structure Descriptor (MSD) 
method on Android platform. The data used consisted of 300 images with 50 
Android classes with each class consists of six images. Performance test is held in three 
Batik scenarios, which the data is divided as test data and data train, with the ratio of 
CBIR scenario 1 is 50%: 50%, scenario 2 is 70%, 30%, and scenario 3 is 80%: 20%. 
Micro-structure The best results are generated by scenario 3 with precision valur 65.67% and 


recall value 65.80%, which indicates that the use of MSD on the android 
platform for CBIR batik performs well. 
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1. INTRODUCTION 

Batik is one of Indonesian culture that is recognized as world heritage. In terms of language, batik 
comes from the merger of two words namely “amba” which means area and “nitik” which means point. So, 
linguistically, batik is a series of points [1]-[3]. Indonesia has a wide range of batik motifs and patterns. In 
fact, batik motifs depict the characters and customs along with the noble values of each local area [4]-[7]. 
This knowledge needs to be introduced to the general public through an easily accessible application. Several 
studies on batik have been proposed, such as the Content Based Image Retrieval (CBIR) technique for 
retrieving batik images using Color Difference Histogram (CDH) [8], enhanced micro-structure descriptor 
[9], Multi Texton Co-Occurrence Descriptor [10], Multi Structure Co-occurrence Descriptor [11], improved 
completed robust local binary pattern [12], Texture Fusion [13]. However, all those studies are build for 
desktop. In this study, a batik image retrieval application is tried to build in android platform. 

Content Based Image Retrieval (CBIR) is one of active research nowdays, thus there are a lot of 
techniques proposed to seek the right method [14]-[17]. Techniques in CBIR, be it CDH and other 
techniques, such as texton co-occurrence matrix, multi-textons histogram, and micro-structure descriptor, 
depend on the feature extraction process [8]-[13]. Types of features can vary, such as color, texture, angle, 
and shape features. An example for the color feature is a gray level co-occurrence matrix (GLCM) that 
extracts features based on gray intensity by changing the image color to gray scale [18]-[20]. Further, an 
example for the edge feature is the use of the Sobel or Prewitt operator, which in some cases the Sobel 
operator provides better performance [21]-[23]. An example of feature texture is the use of texton proposed 
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by Julesz [24]. In practice, CBIR often incorporates several types of features in order to obtain satisfactory 
results, for example merging texture and color features or edge and color features [12]. One of the combined 
feature extraction methods that has been proven to provide satisfactory results for CBIR batik is the Micro- 
Structure Descriptor (MSD) [9]. Thus, MSD is chosen in this study to bulid a batik image retrieval 
application in android platform 


2. THE DATASET 

In this research, batik image dataset was collected through 50 types of batik cloth. For each type of 
fabric, six images were randomly photographed, then resized at 128x128 pixels in JPEG format. Thus, the 
total number of images in the dataset is 300 and consists of 50 classes. An example of a batik image is shown 
in Figure 1. In general, there are two patterns of batik drawings, geometric and non-geometric patterns [12]. 
Dataset is available download at https://github.com/agusekominarno/batik. 


3. MICRO-STRUCTURE DESCRIPTOR (MSD) 


Figure 1. The example of batik images 
The extraction process used was Micro-Structure Descriptor method which is a feature extraction 
technique using texton. In this extraction, from each batik image, a histogram was generated which is a 
vector value for color features and edge orientation. 


3.1. The extraction of color feature 

The most popular color system is RGB, where RGB stands for red, green, blue. The colors 
formed on the RGB system are the result of a mixture of primary colors red, green, and blue, based on 
certain compositions. However, in the world of image processing, in addition to RGB there is HSV which is 
also popular. H in HSV is Hue which expresses the actual colors, such as red, violet, and yellow, which are 
used to determine redness, greenness, etc. Furthermore, S is Saturation, ie purity or color strength. Finally, the 
V for Value indicates the brightness of the color with a range of values between 0% to 100%, where 0% will 
produce purely dark color, while the larger values will produce brighter colors and new variations of colors. 
In this study, the color system used is HSV, where the color was quantized to 72 colors with details of H as 
much as 3 bin, S as much as 3 bin, and V as much as 8 bin. Thus, the total color obtained 
is 3x3x8 = 72 colors. 


3.2. The extraction of edge orientation feature 

The edge orientation has a strong influence on image perception. There are many methods for 
detecting edge features, in this research, edge detection was done with a sobel operator. This is because it 
has the ability to reduce noise before performing edge detection calculations. This capability provides better 
results when compared to gradient operators or other edge approach methods, so it is considered more efficient 
and simple [7]. 

The calculation on the sobel operator is done by weighing the pixels closer to the center of the 
window. Thus, the influence of neighboring pixels will differ according to their location to the point where the 
gradient is calculated. Gradient is the result of measurement of change in an intensity function and an image 
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can be viewed as a collection of several continuous intensity functions of the image. The result of the sobel 
operator is then quantized to 1 8bin, so that at this stage there will be 18 edge orientation features. 


3.3. Texton detection 

Figure 2 illustrates the process in MSD using texton. There are four types of texton, with a size of 
3x3 grids, which are used to obtain micro-structure maps. As an example, let Figure 2(a) be the pixels of 
image with a quantized edge detection value. Using the existing textons, a scanning process of the image is 
performed. For each pattern similar to textons, the pixels are marked, shown in Figure 2(b). Figure 2(c) is 
the result of detection that already shows the micro-structure pattern. Figure 2(d) is a micro-structure map. 
Furthermore, in order to obtained histogram value, the micro-structure map is used as a mask to mark 
considered pixels. Only value from considered pixels are used to compose histogram. The illustration of the 
result is presented in Figure 3. 


(c) (d) 


Figure 2. The illustration of texton detection 


3.4. Precision and recall 
In this study, performance was measured using the precision and recall defined in Equation (1) and 
Equation (2): 


ree img_retrieved_that_relevant = 
Precision = ~2-""* <= x 100 (1) 
img_retrieved 
img_retrieved_thatrelevant 
Recall = 7% = 100 (2) 


img_relevant_in_collection 
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Figure 3. Merged histogram (color and edge) 


4. FEATURE IDENTIFICATION PROCESS (FEATURE EXTRACTION) 

As already mentioned, the method used for feature extraction is MSD. The series of processes of 
CBIR batik implementation with MSD is presented in Figure 4. The initial stage is to get the color feature by 
converting the RGB value to the HSV value. In addition, it also performed edge features extraction using the 
Sobel operator. The second stage is to quantify the value of HSV and edge orientation, so that obtained 72 
color features and 18 edge orientation features. However, these features are not used directly, but look for 
the pattern of occurrences using textons, and resulting micro-structure map. Using this map, then the image 
pixels are masked. Only masked pixels are considered for histogram value, allowing 72 features related to 
color and 18 features related to edge orientation, so the total features obtained are 90 features. 
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Figure 4. The Micro-structure description process 


Figure 5 shows the initial step for color feature extraction process. The initial image used is the RGB 
image as shown in Figure 5(a). When converted from RGB to HSV, the image structure changes, the result 
can be seen in Figure 5(b). In the example image it can be seen that the Hue value tends to produce a red 
color, and the Saturation value decreases. After conversion, the value of HSV is quantized, where the value 
of H is divided into 3 bins, S becomes 3 bins, and V becomes 8 bins. The quantization results also cause a 
change in the appearance of the image, as shown in Figure 5(c). From this quantized image, a 72-vector 
histogram is obtained and presented as Figure 5(d), which furthermore represents as 72 color features. 

Next, Figure 6 is the first step of the edge orientation feature extraction process. First, the image is 
converted to gray scale, shown in Figure 6a. Next, the edge orientation value is calculated using the Sobel 
operator, the result is shown in Figure 6(b). Last is the process of quantizing edge orientation values into 
18 bin. The quantization results are shown in Figure 6(c). The extraction result in this process is a 
histogram with the number of vectors 18, shown in Figure 6(d). 
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Figure 5. The feature extraction process 
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Figure 6. The feature extraction process 


5. RESULT AND ANALYSIS 

Testing was done by using precision and recall. Measurements were made to the images in the 
database containing 300 batik images classified into 50 classes, where each class consists of 6 images. 
There were three test scenarios, the first was to divide the image by 50% of training data and 50% of test 
data, so for each class, 3 images were used as training data and 3 images as test data. The second scenario was 
to divide the images by 70% of training data and 30 % of test data, where from each class there were 4 
training images and 2 test images. The latter was to divide the data into 80% training data and 20% test 
data, therefore, for each class there were 5 images used as training data and | image as test data. 
Furthermore, the measurement of precision and recall values are performed on 6 retrievals, 8 retrievals, and 
12 retrievals. The precision value is shown by Table 1, while the recall value is shown by Table 2. 

The features used in this CBIR are color and edge orientation features. However, these two types of 
features are not used directly, but, look for spatial correlation between the two features to get the histogram 
value. This special correlation was obtained by utilizing the MSD method which uses texton to form a mask 
or a micro-structure. Since there are basically two types of features used, then, the feature dimension used is 
72 color features and 18 edge orientation features, so, totally, there are 90 features used. 

The CBIR system is built on the android platform with input queries taken with the camera of the 
mobile device or retrieved from the database. In terms of execution time, to perform feature extraction 
process against query using MSD and to search for suitable batik image in the data base, it takes about 
1 minute. In addition, the best performance shown by the test with the ratio of training data compared to 
the test data is 80%: 20%, where the precision value is 65.67% and the recall value is 78.80%. 


Table 1. Precicion Rate 
50% :50% 70% :30% 80% :20% 


6 retrieval 39.33% 52.50% 65.67% 
8 retrieval 30.00% 40.38% 50.75% 
12 retrieval 20.06% 27.08% 34.00% 


Table 2. Recall Rate 
50% :50% 70% :30% 80% :20% 


6 retrieval 78.67% 78.75% 78.80% 
8 retrieval 80.00% 80.75% 81.20% 
12 retrieval 80.22% 81.25% 81.60% 
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6. CONCLUSION 

Based on the tests performed, it can be concluded that the CBIR system using MSD (Micro 
Structure Descriptor) which based on android platform can run well or effectively. From the results of the 
research, the best system performance is obtained by dividing the data by 80% or 250 of training data and 
20% or 50 test data, with 6 retrievals, yielding the precision rate of 65.67% and the recall rate of 78.80%. 
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